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^ ! Abstract 



In this letter we analyze the TAP approach to the spherical p-spin spin glass 



' model in zero external field. The TAP free energy is derived by summing 



up all the relevant diagrams for — > 00 of a diagrammatic expansion of the 
free energy. We find that if the multiplicity of the TAP solutions is taken 

X' 

' into account, then there is a first order transition in the order parameter at 

the critical temperature Tc higher than that predicted by the replica solution 

^RSB) but in agreement with the results of dynamics. The transition is of 

"geometrical" nature since the new state has larger free energy but occupies 

the largest volume in phase space. The transition predicted by the replica 

calculation is also of "geometrical" nature since it corresponds to the states 

with smallest free energy with positive complexity. 
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The understanding of the low temperature phase of spin systems with random couphngs, 
namely spin glasses (SG), is still an open and interesting problem. The main feature is the 
complex free energy landscape made of many minima, separated by very high barriers, not 
related by any symmetry one to another. This is responsible for the non-trivial behavior 
of these systems, even at the mean field level which is usually the first step towards the 
understanding of the phases 

Recently a simple mean field model has been introduced to investigate the static 
and dynamical properties of these systems. This is an infinite range spherical SG model 
with p-spin interactions. For any p > 2 the model possess a non-trivial low temperature 
and field phase. Within the Parisi scheme of replica symmetry breaking the most general 
solution for any temperature T and field is obtained with only one step of breaking (IRSB). 
In this paper we shall consider the system without external field. In this case the replica 
approach predicts a first order transition in the order parameter at the critical temperature 
Trsb where the order parameter jumps discontinuously from zero (high temperature) to a 
finite value. The free energy, nevertheless, remains continuous. The study of the dynamics 
yields a similar scenario but with a first order transition at an higher critical temperature 
Tc > Trsb; and a slightly different low temperature phase. This surprising result was first 
noted in Ref. in a soft-spin version of the model. The reason why the two approaches 
led to two different results is that in the replica approach the transition was obtained by 
the requirement of largest replica free energy, while in dynamics it follows from marginality. 
The two conditions are equivalent for the continuous transition in a field, but not for the 
discontinuous one 

In an attempt to understand this result Kurchan, Parisi and Virasoro proposed a TAP 
free energy for this model and showed that in the absence of magnetic field the IRSB solution 
is a solution of the TAP equations. However, strangely enough, this solution does not 
correspond to an extremum of the proposed TAP free energy. Moreover at any temperature 
the replica symmetric solution leads to a lower value of this free energy. Therefore, it is not 
clear why there should be any transition. 
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We have derived the TAP free energy from a diagrammatic expansion of the free energy 
by summing up all the relevant diagrams in the N oo limit. In this letter we show that 
taking into account the degeneracy of the TAP solutions, usually called "complexity" , then 
in the thermodynamic limit N ^ oo this naturally leads to a transition in agreement with 
the results of dynamics. Moreover it gives the constraint under which the TAP free energy 
for the IRSB is minimal. All details will be reported elsewhere. 

The p-spin spherical SG model consists of continuous spins cTj interacting via quenched 
Gaussian couplings. The Hamiltonian is a p-body interaction 

^ N N 
^ i=\ l<ii<---<ip<N i=l 

where we have included an external field hi and a parameter r to control the spin magnitude 
fluctuations. The couplings are Gaussian variables with zero mean and average ( Jji,...,ip)^ = 
p\/{2N^~^). The scaling with N ensures a well defined thermodynamic limit [0. This 
formulation is slightly different from the one given in Refs. In the large A^ limit the 

free energy per spin / of the original spherical model |^,^ and that of the model (|I|), 0, are 
related by 

f{J,T,h) = ^ir,J,T,h)-r/2 (2) 

where r is the value which makes the r.h.s. of @ stationary. This corresponds to impose 
the global constraint YliLi = N on the amplitude of the spins . 

Under general conditions the free energy can be derived from a variational principle. To 
this end, we introduce the magnetization rrii = and the connected spin-spin correlation 
function Gij = {<7i<7j) — {o'i){o'j) of (|l]) for fixed couphngs. Then following Refs. the free 
energy (p can be written as 

pN(f){r,J,T,h) = H{m) + ^TT In G"^ + ^Tr I?"^(m) G - r2(m, G) + const. (3) 

where TT>~^{m) = d'^H{a) / daidaj evaluated for cij = mj. The functional r2(m, G) is given 
by the sum of all two-particle irreducible vacuum graphs in a theory with vertices determined 
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by (P and propagator set equal to Gij. The rrii and Gij are evaluated at the stationary 
point of the r.h.s. of d). 

By taking into account only the diagrams which contribute to the averaged free energy 
in the thermodynamic limit |]T0|, see Fig. |I|, we obtain 



(4) 



m,- . The 

tp 



where Nq = f^i = Q^^'^'^ii Ng = TiG and E = —{l/Np\)Y,Jh....,ipiTT'h 

details will be reported elsewhere. In (^) we did not included the constant term which comes 
from the normalization of the trace over the spin variables |^ since it does not change the 
stationary point. In general E is a. random variable which depends on both the realization 
of couplings and on the orientation of the vector m = (mi, . . . , mTv). Equation (^) is 
a variational principle for the free energy since, for any value of h, r and T, the rrij, or 
equivalently q and m^, and g are determined by the stationary point of (p. 

We shall now consider only the zero external field case. From we see that if hi = all 
situations with the same E will lead to the same free energy. Consequently to have a defined 
problem we consider E as given and study the solution as function of E. This corresponds 
to divide the phase space into classes according to the value of E, and sum over all the states 
in one class. This is a statistics by classification |TT]. 

By eliminating g and r from the stationary point of equations (0) and (Q) 



^ = 1 - g 
1 



+ 4^(1-/-) 



(5) 
(6) 



1-q ' 2 

we are led to the following variational principle for the free energy per spin of the spherical 
p-spin SG model 



/(g, E, T) = q^/^E - | ln(l - g) - ^ [l + (p - l)qP - pqP-^ 



(7) 
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which, for any T and E, has to be stationary with respect to q. Equation for r{q) = 
f3r — (3"^ p/2, is the equation of state first derived in |^ from the study of dynamics. Here r 
disappears being replaced by the free energy. 

The functional f{q, E, T) is related to the generating functional of one-particle irreducible 
graphs, and hence the stationary point is a minimum of /. Equation ([^) is the TAP free 
energy proposed by Kurchan et al and obtained by adding to the "naive" mean field free 
energy, the first two terms in (|^), the Onsager reaction term, the last term in (|^), for the 



Ising p-spin SG model |12 



The stationary point of equation (0) gives, c.f.r. 0, 

(1 - = zT (8) 

where 

z= -E±yF^], E, = -^2{p-l)/p. (9) 

It is easy to understand that for any temperature T, and z low enough, there are two 
solutions of the saddle point equation (j^), one corresponding to a maximum and one to a 
minimum. For z > Zc = z{Ec) the stable solutions leads to an unphysical q decreasing with 
temperature. Therefore, in (|^) we take the 'minus' sign. For z < Zc, and T low enough, the 
stable solution is the largest one, q > 1 — 2/p. The condition z < Zc is equivalent to the 
non negativity of the relevant eigenvalue of the replica saddle point [Q. This confirms the 
assumption made in Ref. on the stability of the TAP solution. Here it comes naturally 
from the analysis of the saddle point. 

The results discussed so far are valid for any fixed E < E^. For values larger than Ec 
there are no physical solutions. The residual dependence of the free energy on E follows 
from the fact that we have summed only over all states within the class selected by the given 
E. Consequently eq. (0) represents the free energy of that class. To have the full partition 
function we have to sum exp(— the partition function of the class E, over all classes, 
including the degeneracy factor. In the thermodynamic limit the sum can be done by saddle 
point, so we have 



/j = min f{Ej,T) 



T 

N 



(10) 



where the subscript "J" denotes that all this has to be done for fixed couplings. In other 
words the minimum has to be taken over all allowed values of E for the given realization of 
couplings. In ( p!OD Af{Ej) is the volume, or density of states, of the class. In general J\f{Ej) 
is a random function which depends on the disorder only through the value of Ej. This 
follows from the fact that for fixed temperature / depends only on the value of Ej. 

By definition fj is a function of the realization of disorder. However the free energy is 
self- averaging. This means that for ^ oo the overhalming majority of sample will give 
the same free energy /(T), i.e. 



As a consequence f(T) can be obtained just averaging eq. ( |10|) over disorder. Due to 
the selfaveraging of Ej this means to replace the second term by lnA/'(-E') and taking the 
minimum over all allowed values of E. 

We have calculated J\f{E) following the lines of Refs. ||13|,|12|. The details will be reported 
elsewhere. The explicit calculation reveals that g{E) = \nN'{E)/N for ^ oo is given by 



This function is an increasing function of E which takes its maximum at the extremum 
E = Ec and is zero for E = -Ersb < E^. In figure |^ we report the behavior of g{E) as a 
function of E for p = 3 where the corresponding values of Ec and -Ersb are indicated. For 
E > Ec there are no physical solutions, i.e. N{E) = 0. For E < E^sb the volume Af{E) 
is exponentially small in A^. Consequently, in looking for the minimum in ([l0|) we have to 
restrict ourselves to values of E in the range -Ersb ^ E < E^. 

Collecting all the results we have that for N oo there exists a critical temperature Tc 
below which the thermodynamics of the spherical p-spin SG model is described by the free 
energy 



for A^ 



oo 



/,(T) = /(T) 



with probability 1. 




(11) 
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/(T) = fiq, E, T) - Tg{E) - | [1 + ln(27r)] (12) 
where q is given by eq. (P) and E is the value which for the given temperature makes the 



r.h.s of ([T^) minimaL The last term, not included before, comes from the normalization of 
the trace over the spins and represents the entropy of the system at infinite temperature . 

The critical temperature is the largest temperature where /(T) is equal to the free 
energy of the replica symmetric solution g = (high temperature solution), and is obtained 
for E = Ec- This corresponds to the critical temperature derived from dynamics from 
marginality. Indeed for E = E^ v/e have z = Zc, i.e. the marginal condition 0]. 

As the temperature is decreased the value of E which minimizes (|12|) decreases until it 
reaches the lower bound -Ersb. This happens at the critical temperature Trsb, the same 
as found in the replica approach. From this point on the value of E cannot be decreased 
further since for lower values the number of solutions is exponentially small in A^. Therefore 
for T < Trsb "we have E = E^sb- We note that while for temperatures in the range 
^RSB ^ T < Tc the free energy (|12D is numerically equal to that of the replica symmetric 
solution, for T < Trsb it is larger. Nevertheless it is the lowest free energy among all the 
accessible states. 

Similarly, in a dynamical calculation we have to restrict to the states with an energy 
corresponding to the largest volume in the phase space where the systems spends most of 
the time in its evolution. In our case the volume is proportional to exp{N g{E)) which 
is maximal for E = Ec, and all other permitted states have exponentially small volume 
compared to this. This means that the time to visit the other states is exponentially large 
in the system size. Therefore in the thermodynamic limit we have to restrict to E = Ec and 



we get the free energy ([T^) with E replaced by Ec for which 

p-2 



9{Ec) = -\ 



ln(j9 - 1) - 2 : 



(13) 



P 

The energy defined by the thermodynamic relation £ = df3f{T)/d(3 is not affected by 
the complexity (|T3p since it does not depend on temperature. Moreover, it turns out that 
the energy so defined is equal to the energy derived from the dynamical calculation [0], 



S = -(^{l-qP + mqP) (14) 

where the parameter m following from the "quasi fluctuation dissipation theorem" is ob- 
tained from the marginal condition: m = (p — 2)(l/g — 1) with q given by (H) with z = z^. 

We note that the free energies calculated in this paper for different E are all higher than 
free energies calculated in the replica approach for different m. They coincide only for the 
IRSB solution. In Fig. ^ we report /(T) as a function of T for p = 15 and different values of 
E. The free energies calculated in the replica approach are all below the IRSB free energy. 
The free energy computed in this paper for the marginal solution corresponds to the correct 
free energy of the dynamical solution. It gives, in fact, the correct dynamical energy while 
the corresponding quantity derived from the replica free energy for the marginal m gives a 
much lower energy. 

In presence of an external field the scenario could be more complex since it is not a priori 
clear if there exists a consistent free energy corresponding to the dynamical state. 

We conclude by noting that quite recently Marinari, Parisi and Ritort found, in a different 



model, numerical evidence of the scenario discussed in this paper [14 
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FIGURES 

FIG. 1. The two-particle irreducible diagrams which contribute in the limit ^ oo to 
T2{rn,G). Each vertex has p lines and gives a contribution — /3Jii,...,ip. Each line joining two 
vertices gives a factor Gij, while each "dead-line" gives a factor m,. 

FIG. 2. g{E) as a function of E for p = 3. The range of E is restricted to E < E^. The value 
E-RSB denotes the IRSB solution. 

FIG. 3. f{T) eq. ( p!2| ) as a function of T for p = 15 and different values of E: (a) E = E^] (b) 
-E'rsb < E < Ec', (c) = -Ersb; (d) the replica symmetric (high temperature) free energy. 
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